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Abstract 


An  extension  of  Ferguson' s\[ Fourth  Berkeley  Symposium  on  Probability  and 


Mathematical  Statistics,  1961,  Volume  1]  univariate  normal  results  for  rejection 
of  outliers  is  made  to  the  multivariate  case  with  mean  slippage.  The  formula¬ 
tion  is  more  general  than  that  in  Schvager  and  Margolinv [Ann.  Statist.,  1982, 


Vol.  10,  No.  3,  943-954]  and  the  approach  is  also  different.  The  main  result 
can  be  viewed  as  a  robustness  property  of  Mardia's  locally  optimum  multivariate 
normal  kurtosls  test  to  detect  outliers  against  nonnormal  multivariate  distribu¬ 


tions  . 
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Rejection  of  Multivariate  Outliers 

Bimal  Kumar  Sinha 
University  of  Pittsburgh 

1.  Introduction. 

After  the  pioneering  work  of  Ferguson  (1961)  on  the  detection  and  rejection 
of  outliers  in  samples  from  a  univariate  normal  distribution  with  either  mean 
or  variance  slippage,  recently  a  lot  of  work  has  been  done  on  the  problem  of 
estimation  of  parameters  and  tests  of  hypotheses  of  parameters  in  some  parti¬ 
cular  probability  models,  assuming  the  presence  of  some  outliers  in  the  data 
and  appropriately  taking  care  of  this  situation  [Kale  and  Sinha  (1971) ,  Joshi  (1972) , 
Sinha  (1972,  1973a, 1973b, 1973c, 1975,  1976),  Chikkagoudar  and  Kunchur  (198Q)] . 

These  two  aspects  of  the  problem  of  outliers,  as  mentioned  clearly  in  Schwager 
and  Margolin  (1982),  are  entirely  different  though.  Generally,  one  needs 
one  kind  of  techniques  to  determine  if  outliers  are  present  and  to  identify 
them,  and  a  different  kind  of  techniques  to  suitably  modify  a  statistical  analy¬ 
sis  for  purposes  of  Inferences  to  incorporate  the  information  regarding  the 
presence  and  identity  of  outlying  observations. 

The  literature  on  these  dual  aspects  of  the  outlier  problem  is  vast.  An 
excellent  survey  appears  in  Barnett  and  Lewis  (1978)  and  also  in  Hawkins  (1980) . 
While  most  of  the  work  in  this  direction  is  in  the  area  of  univariate  distri¬ 
butions  and  that,  too,  often  for  a  specific  probability  model,  some  aspects 
of  the  multivariate  outlier  problem  are  available  in  Siotani  (1959),  Karlin 
and  Truax  (1960),  Healy  (1968),  Rohlf  (1975)  and  also  in  Ferguson  (1961).  A 
discussion  of  multivariate  outliers  from  a  data  analytic  viewpoint  is  available 
in  Gnanadesikan  (1977). 
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The  motivation  for  the  present  investigation  lies  in  a  recent  paper  of 
Schvager  and  Margolin  (1982)  who  derive  a  locally  optimum  procedure  for  de¬ 
tection  of  multivariate  normal  outliers  against  departures  in  the  mean.  The 
paper  has  some  very  Interesting  features.  First,  after  Ferguson's  (1961)  work, 
this  seems  to  be  the  only  paper  attempting  successfully  to  generalize  the  con¬ 
cept  and  techniques  of  tFerguson  to  the  multinormal  case.  Secondly,  interestingly 
enough,  it  turns  out  that  the  locally  best  invariant  test  for  outliers  (under 
a  suitable  group  of  transformations)  against  mean  slippage  alternatives  is 
based  on  Mardla's  (1970)  multivariate  sample  kurtosls.  However,  the  paper 
suffers  from  two  drawbacks.  It  is  argued  that  the  multivariate  normal  error 
structure,  the  model  actually  adopted  in  the  paper,  has  some  advantages  in 
terms  of  mathematical  tractability  etc.  We  will  show  that  the  assumption  of 
multlnormality  of  the  error  components  can  be  dispensed  with  without  essentially 
any  difficulty.  Another  drawback,  the  less  serious,  is  that  the  ultimate  op¬ 
timality  result  is  obtained  via  some  heavy  calculations. 

Our  object  in  this  paper  is,  therefore,  two-fold.  We  extend  the  results 
of  Schwager  and  Margolin  (1982)  to  nonnormal  multivariate  populations  and  in 
the  process  provide  a  simpler  derivation  of  the  main  optimality  result. 

Interestingly  enough,  a  new  test  also  emerges  out  of  this  formulation  (vide 
Remark  3.1),  which  is  locally  optimum  uniformly  for  all  mean  slippage  alter¬ 
natives.  This  derivation  of  course  depends  mostly  on  the  existing  calcu¬ 
lations  of  Schwager  and  Margolin  (1982).  Under  a  certain  condition  on  the 
number  of  distinct  outliers  present  in  the  data,  an  alternative  independent 
proof  of  the  main  result  is  also  provided.  The  class  of  nonnormal  multi¬ 
variate  populations  we  consider  is  well  known  in  the  context  of  robust  tests 
for  some  multivariate  problems  (see  Kariya  and  Eaton  (1977)  Kariya  (1981a, 1981b) , 
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sinha  and  Drygas  (1982)  for  a  univariate  problem) .  The  main  tool  we  use  is  a 
representation  theorem  due  to  Wijsman  (1967). 

The- multivariate  outlier  problem  is  formulated  in  Secion  2.  Section  3 
contains  the  main  result.  The  alternative  proof  is  provided  in  Section  4. 

Some  of  the  calculations  necessary  for  this  section  are  deferred  to  in  the 
Appendix. 

2.  The  Multivariate  Outlier  Problem. 

Let  0(n)  and  S(p)  denote  the  set  of  n*n  orthogonal  matrices  and  the  set  of 

pxp  positive  definite  matrices  respectively.  For  an  n*p  random  matrix  U,  we 

denote  by  L(U)  the  distribution  of  U.  We  call  U  elllptically  symmetric  about 

M  with  scale  matrix  Z«S(p)  if  L( gY)  -  L(Y)  for  all  ge  0(np) ,  where  Y  - 
»  -1/2 

^.....Y  )  ,  Y  is  the  ith  row  of  Y  -  (U-M)Z  '  .  Let  X-  {U:  n*p|rank  (U)  »p}. 

Throughout  the  paper,  n ^p+1  is  assumed.  Moreover,  we  denote  by  F(M,In  9  E)  the 
class  of  np-dimensional  elllptically  syoDetrlc  distributions  about  M  with  scale 
matrix  EeS(p)  such  that  PtU-MeX}  =  1.  We  assume  that  L(U)  e  F(M,In  fl  E)  has  a 
density  (with  respect  to  the  Lebesgue  measure)  which  is  expressible  as 

(2.1)  f  (u|M,Z)  -  |z|-n/2  <Ktr  E-1(U-M)  ’  (U-M) ) 
where  [0,«)  -+■  [0,»). 

Consider  a  random  sample  of  size  n  from  a  multivariate  distribution.  We  will 
denote  the  sample  by  X:  n*p  and  assume  that  the  following  model  holds: 

»  -1/2 

(2.2)  X  -  1  y  +UE  ' 

where  1  is  the  unit  vector  (n*l) ,  y  is  the  unknown  common  mean  vector  (p*l)  of 
the  rows  of  X  and  the  random  error  component  U  has  a  distribution  L(U)  e  F(0,I  fll  ) 
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with  a  density  given  in  (2.1)  with  M  -  0  and  I  ■  I  .  This  is  equivalent  to  the 

f 

specification  that  i(X)  e  F(ly  ,  I  8  E).  It  is  clear  that  our  formulation  is 

_  n 

more  general  than  Schwager  and  Margolin's  (1982)  in  that  <t>  is  arbitrary.  Some 
mild  regularity  conditions  on  $  which  will  be  needed  in  the  sequel  are  presented 
later. 

In  this  paper  we  consider  the  possibility  of  outliers  with  mean  slippage. 

For  any  matrix  A  -  (a^):  n*p  ,  extending  Ferguson's  (1961)  formulation  and 
proceeding  as  in  Schwager  and  Margolin  (1982) ,  this  can  be  incorporated  by 
considering  the  model 

(2.3)  X  -  ly' +AAl“1/2  +  UI_1/2 

Here  A  is  a  nonnegative  scalar  and  A  is  an  arbitrary  matrix  such  that  some  of 
the  rows  of  A  are  zero.  In  this  formulation,  unless  A  ■  0,  the  observation  X^ 
corresponding  to  the  1th  row  of  X  is  an  outlier  if  the  ith  row  of  A  is  nonzero. 

In  Section  4  we  assume  that  the  rank  of  A  is  p  which  imposes  a  constraint  on 
the  number  of  distinct  outliers  present  in  the  data  whenever  A  >  0 .  When  n  is 
large  compared  to  p,  such  a  condition  may  not  be  unrealistic.  We  remark  that 
Schwager  and  Margolin  (1982)  assume  on  the  other  hand  that  more  than  half  of 
the  rows  of  A  are  zero  and  for  large  n  this  still  might  ensure  rank  (A)  equal 
to  p. 

Henceforth,  we  will  assume  that  we  have  chosen  an  arbitrary  matrix  A  whose 
some  of  the  rows  are  zero.  The  general  multivariate  outlier  problem  then  con¬ 
sists  of  the  model  (2.3),  the  distributional  assumption  about  U:  L(U)  e  F(0,I  I  I  ), 

n  p 

and  the  null  hypothesis  Hq!  A  -  0  versus  the  alternative  hypothesis  H^:  A>0. 

In  what  follows  we  will  derive  a  locally  optimum  test  of  Hq  against  using 
invariance  principle.  It  may  be  noted  that  rejection  of  Hq  implies  presence  of 
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outliers  in  the  data  according  to  the  assumed  structure  of  A.  However,  as  will 
be  seen  later  (vide  Remark  3.2)>  the  optimum  test  obtains  for  a  wide  variety 
of  outlier  structures. 

Following  Schwager  and  Margolin  (1982) ,  it  is  clear  that  the  above  testing 
problem  remains  invariant  under  the  action  of  the  group  G  »  P  *Gl(p)  *  K1  where 
P  denotes  the  group  of  all  n*n  permutation  matrices  with  elements  r  ,  Gl(p) 

ot 

the  group  of  pxp  nonsingular  matrices  with  elements  C  and  RP  the  Euclidean 

p-space.  The  three  (sub)group  operations  are  defined  by:  (1)  addition  of  an 
*  P 

arbitrary  vector  y  e  It  to  each  row  of  X;  (2)  postmultiplication  of  X  by  any 
nonsingular  matrix  C  e  Gl(p)  and  (3)  permutation  of  the  rows  of  X  by  premulti¬ 
plying  X  by  rQ  e.  P.  For  details  see  Schwager  and  Margolin  (1982) .  In  the  next 
section  we  derive  the  distribution  of  a  maximal  Invariant  statistic,  applying 
Wijsman's  (1967)  theorem.  This  method  does  not  require  an  explicit  evaluation 
of  a  maximal  invariant  statistic  although  this  is  available  in  Schwager  and 
Margolin  (1982) . 


3.  Main  Results. 

Without  loss  of  generality,  by  invariance  of  the  problem,  we  may  assume 

y  -  0  and  I  ■  1^.  To  obtain  a  formal  expression  of  the  distribution  of  a  maximal 

invariant  T(X),  we  use  the  following  version  of  Wijsman's  (1967)  theorem. 

Lemma  3.1.  Let  h(x|A)  ■  $  (tr(x-AA) ' (x-AA)  be  the  pdf  of  X,  let  T  ■  t(X)  be  a 

T 

maximal  invariant  under  the  transformation  G  and  let  P.  be  the  distribution 


induced  by  T  under  A.  Then  the  pdf  of  T  with  respect  to  P^  evaluated  at 


T  ■  t (X)  is  given  by 


(3.1) 


dp 


dP 


(t(X))  - 


h(g*x| A) |C'C|n/2  dv(g) 


h(g*x|A-0) |c’Cjn/2dv(g) 
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where  v  is  a  left  Invariant  measure  on  G. 

Conditions  under  which  (3.1)  holds  are  stated  in  Wijsman  (1967)  and  have 
been  verified  in  many  contexts  under  similar  group  structures  (see  Kariya  and 
Eaton  (1977),  Kariya  (1978,  1981a,  1981b).  The  details  are  omitted  here. 

For  some  applications  of  Wijsman's  (1967)  theorem  in  multivariate  testing 
problems  with  incomplete  data  see  Eaton  and  Kariya  (1975)  and  Sinha  et  al  (1982) 
We  now  proceed  to  explicitly  evaluate  (3.1).  The  transformation  g*x  is 
given  by  (vide  Schwager  and  Margolin  (1982)) 

(3.2)  g*x-raxC  +  l  u*'  ,  rae  P,  C  e  Gl(p)  ,  y*  e  mp 


and  we  take  v  »  vixv2xv3  w*iere  *s  the  discrete  uniform  probability  measure 

with  mass  at  each  of  the  n!  elements  r  €  P,  dv0(C)  *dc/|c'c|p^2  and  dv_(y  ) 
n«  a  z  j  « 

p 

is  the  Lebesgue  measure  on  K  . 

fremmit  3.2.  The  ratio  of  the  pdfs  in  expression  (3.1)  is  evaluated  as 

Za  J  <|.[tr(c'c-2AC,S_1/2(rax-lx'),A+A2(A,A  -  ^-|^)]|c,C|~?'dC 


(3.3) 


f  -  Hl£ 

S  <fr[tr(C,C)]|C,C|  2  dC 

Gl(p) 


for  some  $  :  [0,®)  ■>  [0,®),  where  denotes  the  summation  over  n!  terms  repre¬ 

senting  permutations  of  the  rows  of  x,  x  the  sample  mean  vector  and  S*x'x-n  xx ' 

Proof.  The  numerator  (say)  of  (3.1)  can  be  written  as 

.  .  SZE. 

(3.4)  *  nT  2o  I  I  $(tr(x'x-Ax’  A-AA,x+A2A'A|x-+g»x))  |C’c|  2  dC  dv^(y  ). 

Gl(p)  *P 


The  argument  of  $,  after  the  substitution  x  *  g*x,  simplifies  to 


•. 


(3.5)  tr[(I\  xC+1  y*')'(r  xC+1  y*')  -2  A  A'(r  xC+1  y*')  +  A2A'A] 

u  -  ct  «  ^  ot  -  - 

-  tr(C'x,r*raxC+2n  C'xy*  +  n  y*y*  -  2  A  A'r^xC-2  AA'ly*  +  A2A'A) 

-  tr(C'x'xC  -  2  A  Xr  xC  + A2A’A -  nCC'x  A'l)  (x'C  -  —  l’A)  +n  c*c*'\ 

-  tr(C'(x,x-n«,)C-2AC,(r  x-lx’)  'A  + A2(A'A )  +  n  c*c*’). 

*  a 

In  the  equalities  above,  c*  *  y  1  A  +  x'C  and  we  have  used  the  fact  that 

x'r'r  x-x'x,  V  T  €  P.  Since  dv,(y*)  ■  dv,(c*) ,  using  a  result  of  Dawid  (1977), 
a  a  a  j  .  j  , 

integration  with  respect  to  c*  over  "B?  yields 

.  A'll'A  SlE 

(3.6)  N-- Vi  $[tr(C*  (x'x-nxx')C  -  2AC'  (T  x-lx')  *A+A2(A'A - =^— ))]  Ic'cl  2  dC 

A  n.  a  j  —  a  ~~  n 

G1(P) 

for  some  ♦:[0,»)  -*■  [0,«). 

Now  x'x-n  xx'-S,  the  sample  sum  of  squares  and  products  matrix,  is  p.d. 

1/2  1/2  1/2 

by  our  assumption  n^p+1.  Writing  S  *  S  S  where  S  is  the  positive  square 

1/2 

root  of  S  and  making  the  transformation  C  -*•  S  C,  reduces  to 

|s|-n/2  f  -  _  2  A'll’A 

(3.7)  -  Z0  J  <Ktr(C'C-2AC'S  A/Z(raX-lx') 'A+A  (A'A - )]|C’C|  L  dC 

Gl(p) 

Since  the  denominator  of  (3.1)  corresponds  to  with  A-0,  the  lemma  follows. 


We  now  proceed  to  explicitly  evaluate  the  expression  in  (3.3).  Making  a 

transformation  from  C  to  -C,  it  is  clear  from  (3.3)  that  the  ratio  of  the  pdfs 

2  2 
depends  only  on  A  .  We  show  that  the  coefficient  of  A  in  this  ratio 

n-p 

(3.8)  6,  -  Z  [  (tr{AC's"1/2(r  x-lx')'}]2  <f>(2)(tr  C'C)|C'C|  2  dC, 

2  a  J  a 

Gl(p) 


apart  from  another  constant  term  depending  only  on  A,  is  a  constant,  and  that 

4 

the  coefficient  of  A  in  the  ratio 


(3.9)  «4-£aJ  [tr{AC'S  (T^x-lx') ' }J  4>  y(tr  C'C)  |C'C|  c  dC, 

Gl(p) 


apart  from  other  terms  including  (3.8)  which  are  constants,  is  of  the  form 
KjT(x)»  L(A)+K2  where  K^>0,  K2  are  constants. 


(3.10) 


n  -  .  / 

T(x)  -  b2>p  =  n  l  {(x±-x)'S  (x^x)}' 


(3.11) 


L(A)  -  (nJ+nz)  J  || Y  |j 4  -  (n2-n)  [2  £  (y!y  )Z  +  (  £  MV) 
i-1  1  i,j-l  J  i-1  1 


•  .  v2 


with  Y^  ■  (®^“fl)  f  IIyJI  m  3C  *  (x^, .  *  •  ,x^)  and  A  =  (a^, . . • ,a^) . 

Evaluation  of  6„.  This  is  based  on  the  following  elementary  result  whose  proof 
is  omitted. 

Lemma  3.3.  Z  {tr(BA  )}2  -  l'B(Z  A  A')B’  1. 

— — — —  a  a  _  a  a  a 

-1/2  -  - 
Taking  B  -  AC',  Aq  -  S  ( T^x-lx ' ) '  and  using  the  fact  that  ^(r^x-lx') ' (r^x-lx'yn! 

■  S,  it  follows  that 


(3.12) 


«2  -  n!  (l'AC'CA'l)  <|>(2)(tr  COjCcI  2  dC 


Gl(p) 


which  is  a  constant. 


Evaluation  of  6^.  This  is  primarily  based  on  some  results  derived  by  Schwager 

and  Margolin  (1982).  Write  tr{AC's"1/2(r  x-lx’) • }  -  trCr'AC'S^^x-lx') ’ }  - 
_  a  .«  a 

n  . 

£  C  a^a  where  x  is  any  specified  realization  of  T^x,  ^  *  S  '  6^  is  the 

ith  column  vector  of  (x-lx')'  and  a.  is  the  ith  column  vector  of  A’T  .  Since 
n  "  ~ia  a 

I  is  a  null  vector,  in  the  last  equality  above  we  can  replace  aia  by  Yia  * 


•>  ^  O  <  vT  O  *.’  V  *W  \  «,  %  -.  \  \  \  ‘.  ",  •.  V  *.  /.  .  *.  .*•  .  -  ■  ,  •  .  -  .  •  . 
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the  ith  column  vector  of  (AT  -al’)*  We  now  use  the  results  of  Section  5  of 

a  -- 

Schwager  and  Margolin  (1982).  Their  Theorem  5.1  is  applicable  directly  and 

their  Lemmas  5.1  and  5.2  and  Theorem  5.2  are  used  with  $  suitably  redefined  as 

_  nz£ 

*  -  cjx  <f>(4)(tr  COlCcj  2  dC. 

Gl(p) 

The  justification  follows  easily  because  the  above  results  are  independent  of 
any  particular  structure  of  the  underlying  probability  distribution  and  actually 
depend  on  the  invariance  of  the  associated  measure  under  orthogonal  transforma¬ 
tions  .  This  yields 

n  , 

(3.13)  5  *  (n-4)  !  $  L(A)  {  l  ||?  |f}  +  K 

4  i«l  -1 

where  L(A)  is  as  defined  in  (3.11).  This  completes  our  demonstration  since 
||  Cfll  2  -  (x1-x)*s"1(xi-x). 

Incidentally,  our  argument  leading  to  the  evaluation  of  6^  implies  that 
L(A)  can  also  be  defined  in  terms  of  a^'s  instead  of  y^'s.  Our  main  result  is 
the  following. 

Theorem  3.1.  Assume  that  <j>  satisfies  (i)  $  <  °°,  (ii)  <J>(x+y)  admits  a  Taylor 
expansion  in  y  for  every  x  with  continuous  fourth  order  derivative,  and 
(iii)  that  the  first  four  derivatives  of  the  power  function  of  an  invariant 
test  with  respect  to  A  can  be  carried  out  beneath  the  integral  sign.  The 
locally  best  invariant  locally  unbiased  test,  conditionally  on  A,  rejects 
H_:  A«0  for  large  values  of  b.  if  $  •  L(A)  >  0  and  small  values  of  b,  if 

0  2,p  2  ,p 

4»  •  L(A)  <  0. 

Proof.  An  application  of  Lemma  3.2  and  the  generalized  Neyman-Pearson  Lemma 
along  with  the  quantities  completes  the  proof  of  the  theorem.  The  rou¬ 
tine  details  are  omitted  (see,  for  example,  Kariya  (1981b  )).  □ 


LO 


Remark  3.1.  Suppose  for  a  moment  that  we  evaluate  <5^  the  other  way  around. 
The  argument  used  to  evaluate  5^  along  with  the  symmetry  of  x  and  A  then 
yields  another  expression  for  5^  given  by 


(3.14)  6.  «  (n-4)  !  $  L(x){  l  ||y,||4}  +  K 

*  1-1 
n  4  n  _  _  , 

where  £  ||yJ|  -  £  {(a.-a?  (a^4)  }*  and  L(x)  has  the  same  expression  as  L(A)  in  (3. 

i-1  i-1  '  3  2  n  -  -1  -  2 

with  y.  replaced  by  £ . ,  i  -  1, . . . ,n. i-e.  L(x)  -  (n  +n  )£  (x  -x)’S  (x  -x)  }  - 

-i  .1  i-i  -1  -  -1  ' 

(n2-n) [2^  {x  -x)'S  ^(x  -x)}2  +  {£  (x,-x)'S  *(x  -x)}2].  It  then  follows  that, 
i.j-l'1  '  '  i-1  '  ' 

unless  a^'s  are  equal,  the  locally  best  invariant  locally  unbiased  test  rejects 
Hq  for  large  values  of  L(x)  whenever  $>0.  This,  to  our  knowledge,  is  a  new 
test  statistic.  Interestingly  though,  for  p-1,  this  boils  down  to  the  familiar 


univariate  b^test  (Ferguson,  1961) . 

Remark  3.2.  As  mentioned  in  Schwager  and  Margolin  (1982) ,  the  local  optimality 

of  the  b.  -test  obtains  for  a  specific  A  and  a  universal  optimality  (local) 

*«P 

result  holds  whenever  the  fraction  of  nonzero  rows  of  A  is  at  most  212 .  On 


the  other  hand,  it  follows  from  Remark  3.1  that  whenever  there  are  some  outliers, 
the  test  based  on  $L(x)  is  locally  optimum. 


Remark  3.3.  The  class  of  nonnormal  distributions  d>  considered  in  (2.1)  con¬ 
tains  the  (np-dimensional)  multivariate  t-distribution,  the  multivariate  Cauchy 
distribution,  the  contaminated  normal  distribution  and  more  generally  continuous 

normal  mixtures  of  the  type  f  -  N(ulM,a£)  dG(a)  where.  N  is  the  normal  density 

‘'0 

and  G  is  a  distribution  function  on  (0,°°).  For  such  an  f,  it  is  easy  to 
justify  the  conditions  in  Theorem  3.1  (see  Ferguson  (1961))  and  it  turns  out 


ID 


that  *  >  0 . 
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4.  Alternative  Proof. 

In  this  section  we  provide  an  alternative  proof  of  the  main  result  under 
the  assumption  that  the  rank  of  A  is  p.  The  key  to  this  is  the  following. 


Lemma  4.1.  Under  the  assumption  rank  (A)*p,  the  ratio  of  the  pdfs  in  (3.3) 
further  reduces  to 


.1 J 

(4.1) 


r  A’ll'A  n~P 

f  *  1/2  2  ”  “  o 

£  <|>[tr  C'C- 2  A  tr  D  C  +  A  tr(A'A - — — )]|C'C|  dC 

“  «!(-'  a  n 


J  <|>[tr  C’C]  |C’Cl  2  dC 
Gl(p) 


where  D  is  a  diagonal  matrix  with  the  diagonal  elements  as  the  eigen  values  of 
a 

the  matrix  A’(T  x-lx’)  S^1(T  x-lx')  A. 
a  a 

Proof .  Clearly  rank  (A)  -  p  implies  that  the  matrix  (T^x-lx) 'A  is  no.singular  for 
almost  all  x  and  therefore  the  matrix  P  defined  by 

(4.2)  P  -  [A'(rax-ix,)s_1(roix-ix,),A]’1/2  A'(T  x-lx')S“1/2 

is  orthogonal.  The  transformation  C-*-PC  then  reduces  displayed  in  (3.7)  to 

|srn/2  f  -  -  -1  -  1/2  2  A,11’A 

(4.3)  N  - : —  I  <J>[tr(C'C-2A(A'(r  x-lx')S  x(r  x-lx’ ) ’A)  /<cC+A  (A'A - — ))] 

A  n!  a  a  --  a  n 

Gl(p)  SzE 

*  lc'cl  2  dC 

Write  A'(r  x-lx')S-1(r  x-lx^'A-Q'D  Q  for  some  orthogonal  0  and  diagonal 
ct  ol  .  ~  a  a  a  a 

D  -  diag  (X,  , . . . ,X  )  where  X.  ,...,X  are  the  eigen  values  of  the  asso- 
a  la  pa  la  pa 

elated  matrix.  The  measure  dC/|c'c|p/2  being  both  left  and  right  invariant,  it 
follows  that  a  double  substitution  C  -*■  QaC-*-CQ^  in  (4.3)  transforms  to  the 


final  form 
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,  -n/2 


(4.4)  N. 


n! 


|  <j)[tr  C'C- 2  A  tr  Dy2C  +  A2tr(A'A  - 


A'll'A 


SZE. 

)]  [C'C|  2  dC, 


Gl(p) 


thereby  proving  the  lemma.  □ 

The  appropriate  version  of  the  main  result  Is  stated  below. 

Theorem  4.1.  Assume  that  $  satisfies  the  conditions  of  Theorem  3.1.  The 


locally  best  invariant  locally  unbiased  test,  conditionally  on  A,  rejects 


Hn:  A  -  0  for  large  values  of  b„  if  $L  (A)  >0  and  small  values  of  b„  if 

0  "  2,p  2,p 

*  * 

$L  (A)  <0,  where  $  is  as  defined  in  Section  3  and  L  (A)  is  defined  in  (4.7) 


Proof.  There  are  two  main  steps  in  the  proof  of  this  theorem.  As  in  Section 


3,  making  a  transformation  from  C  to  -C,  it  is  clear  from  (4.1)  that  the 


2  2 

ratio  of  the  pdfs  depends  only  on  A  .  We  show  that  the  coefficient  of  A  in 


this  ratio 


HlE. 


(4.5)  Z  {tr  D1/2C}2  $(2,(tr  C'C^C'Cl  2  dC, 

a  j  a 


Gl(p) 


apart  from  another  constant  term  depending  only  on  A,  is  a  constant,  and  that  the 


coefficient  of  A  in  the  ratio 


SlE. 


(4.6) 


Eq  j  (tr  Dy2C>*  (tr  C'C)|C'C|  2  dC, 
Gl(p) 


apart  from  other  terms  including  (4.5)  which  are  constants,  is  of  the  form  K^b^ 
where  >  0 ,  are  constants  and 


(4.7) 


L*(A)  -  (n3+n2-4n)  J  (f  a2  ) 2-(2n2-4n) 
k-1  i-1 


f  l 

i-1  j-1 

+  8n  f  ^  (a'a,)(a'l)(a!l)  +  4n  (^  a'a.M^  (a'l)2} 

i-1  j-1  1  J  ~J~  i-1  -1'1  i-1  ~X~ 


)2  -  (n2+nXh  (a'a  )  ^ 
i-1 


-  4(n2+n)  [  f  I  (a'l) 
i-1  j-1  k-1 


aikaj2k  *  6%  (?IP2>2 


•,  /• ,  ;•  ,*■  .*•  .  *  - 


»  -  v  * - 


Was 


4L*(A)+K 
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where  Is  the  1th  column  of  A. 

An  application  of  the  generalized  Neyman-Pearson  lemma  then  completes  the 
proof  of  the  theorem.  □ 


Evaluations  of  (4.5)  and  (4.6).  We  use  the  following  general  result.  For  any 


integrable  function  <|>(tr  C'G)  :  [0,®)  ■+  [0,®), 

r> 


V.  V„  v„ 


n-2. 


.  .  for  i®j*£,  v,+v.+v_  even 

Vl+V2+V3  123 


(4. 


G1(P) 


for  i»j^£,  v  +v2  aiu*  v3  even 


for  i^j/i,  at  least  one  of  v 
v_  odd 


v^+\>2  and  odd 


where  6's  are  constants.  Using  (4.8),  the  expression  in  (4.5)  reduces  to 


(4.9) 

and  that  in  (4.6)  to 


Vi.1V-42<*<2>) 


(4.10)  E41iL>V*<'')>*3  Xi«V52.2(4(4)) 

Lemma  4.2.  fi2>2(^(4))  -  \  . 


Proof.  The  proof  of  this  result  follows  from  that  of  Lemma  5.2  of  Schwager  and 
Margolin  (1982) .  Note  that  this  latter  result  proved  under  the  normality  assump¬ 
tion  also  holds  whenever  the  underlying  distribution  is  orthogonally  invariant.  □ 
In  view  of  Lemma  4.2,  the  expression  in  (4.10)  bolls  down  to 


) 


(4.11) 
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l  (i  l 

Note  Chat  ;  Is  nothing  but  $  defined  in  Section  3.  We  now  prove  the 

following  result  towards  evaluating  (4.9)  and  (4.11). 


•A*  (»)  E. (5  J  -  a 


VM 


constant  (depending  on  A) 


(b)  S  (f  X  )2  *  (n-4)!L*(A)  +  a  constant  where  L*(A)  = 


“i-1  ia 


Proof,  (a) 


(4.12) 


II  4  j,  1. 1 ) )®i  is  evaluated  in  (4.22) 

ij  -1  -J 


X.  ■  tr  D  -tr  A’(T  x-lx’)S~1(r  x-lx’)’A 
la  a  a  a 


:i  a 


e’A' (T  x-lx')S_1(r  x-lx')'A  e 


a  'z± 


-  I  a'(r  x-l5')S_1(r  x-lx')a 
1-1  ~  "  "  ~ 

-  !  i  (aizia)2 

i-1  i-1 

where  e^  -  (0...1...0)  with  1  at  the  ith  coordinate,  -  the  ith  column  of 
A(nxl),  S  1  is  written  as  S_1  -  f  ~  P^Pj  and  Z&o  -  (r^x-lx')?^^—  .  Hence,  using 

a  result  of  Ferguson  (1961) , 


(4.13)  IQ(!  Xl0.)  -  f  f  I  Cn-2)![n  Caja  >-C«;i)2]*J  z 

i-1  i-1  i-1  £-1  i-1  ~1'-1  '  a'  a 

-  (n-2)![f  ^  {n(a^ai)-(a’l)2}][|^{P][(rax-lx’)»(raX-lx,)PJl/X]l}] 

-  (n-2)  !  {n(a'a.)-(a'l)2}]  PlSP./X,]  -  p(n-2) !  [f  (n(a>,)-(a'l): 

i-i  ~i~1  '1'  £-1  *  i-1  -1-1  ' i- 


thereby  proving  the  first  part  of  the  lemma. 

(b)  The  proof  for  this  part  of  the  lemma  is  slightly  involved.  Using  the  last 
but  one  step  of  (4.12),  we  can  write 
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(4.14) 


(f  )2  -  7  ?  a'(r  x-lx')S  1(r  x-lx') 'a  *a!(r  x-lx')S  ^(r  x-lx’)'a. 

ia  i-i  ~i  a  a  --  >1  -j  a  --  a  7  ,j 

-  f  !  I  l  K*la)2(aj!£'o>2 

i-H'-l  j-li-1  °  ° 

-  f  f  !  ^  aI(ztaZta)ai  al  * 

l-l  i'-l  j-1  i-1  ~x  ~m~ta  -1  ~J  ®  -J 


The  nxn  matrix  (z  z'  )  a  a!(z  ,  z',  )  -  A  ...  (say)  appearing  in  (4.14)  can 

oi  *i.j  .tu.ia  it  i  »i,j»a 

2  2  2  2 

be  expressed  as  the  product  of  three  matrices  of  orders  nxn  ,  n  *n  and  n  *n 


respectively  as  shown  below. 


(4-15)  V.M.J..' 


?t  °  —  °j 

0  o!  ...  0  • 

.  .  .  ... 

0  0  ...(}'  z  z*  e  ei'z.,  z' , 

l  ij  .lx.Io.nri.i  a.i'o 


z.  z '  e,  e '  z  ,  z ' , 
.ia_to_l.n-A 'a-*  a 


z  z'  e.e'z  .  z', 
_£a-£a-i.n-£  'a,£  ’a 

z  z'  e  e'z  ,  z' , 
_£a.£a.n-n_£'a.t'aj 


0  ...  0 

0  “j  •••  o 


[?  ?  •*,®j 


The  crux  of  the  problem  now  is  to  evaluate  the  sum  of  all  possible  n  *n  matrices 
appearing  in  the  middle  of  (4.15)  over  &,£'  and  permutations  a.  This  is  carried 
but  in  the  Appendix.  It  is  proved  that 

(4.16)  f  I  £  z.  z'  e.e’z.9,  z'  --2xE  (n-3)  !  (2  11’ +  (n2-2n)e.  e'-nA.  ] 
i-1  i'-l  °-a  0  n  jc-k  k 

+  another  matrix  of  constants 

(4-17>  ,tj  i1'+(-n2+3n)<ek!k+!k'ek,+*kek. 

+  ?k’!k)  +  2n  Ak.kfl 


+  a  matrix  of  constants 


where  A  is  a  matrix  with  l's  in  the  diagonal  and  also  in  the  kth  row  and  kth 
k 

column  and  0  elsewhere,  and  Ak  k,  is  a  matrix  with  l's  in  the  diagonal  and  also 
in  the  kth  row,  k'th  row,  kth  column,  k'th  column  and  0  elsewhere.  Using  (A. 16) 


and  (4.17),  we  get 


(4.18)  f  ?  E  A  ,  .  .  — ^  (n-4)!((6  .  .  ,))  +  a  matrix  of  constants 

i-1  1  °  n  i*!***16 

where 

(4.19)  6±  k  k- 2(n-3)(a|l)(ajl)+(n-3)(n2-2n)(a^ek)(a^e]t)-n(n-3)o’Akaj 

+  2n 


Hence,  from  (4.14),  (4.18)  and  (4.19),  one  gets 

(4.20)  E  (1  A.  )2-  if  I  a’«S5  .  k  k,»  a  ]•  (n-4) !  +  a  constant  term. 

“i-l  ia  i-1  j-1'1  ’  -3 

t 

To  evaluate  the  bracketted  quantity  in  (4. 20), note  that 

(4.21)  ’J^'lk'jk  Sl,),k.k  k/f.!  *lk*jk'  ^.j.k.k1 

-  [2(a-3)J  «lk*jk(«il)  <'>2-2"^1‘LaJk-n<n-3>^lk,)k(“i\?j)  1 

+  >6<;iP(?i“jk,.1,lk,)k'+(-”2^|j1alk*Jk^lk!a1K+*lk*)k-+alk!Vl*lk*jk 


+  2nki'.JIk*3k,<-1 4k-k’-j! 


2  n  2 

-t2(n-3)  (ajOj)  (a^l)  (ajl)+(n-3)  (n^-2n)  (J  aJkaJk>-nCn-3H  (.a^)  ^“i^^Jk^k 


+  (aIDlaLai.-2  l  a?„a2>] 


t  I  Iff 


+  +  <-n  +3°) {(I  •lk*jk)(;Jl)-  I_  »lk»jk 

,  ,r  2  w  '  r  22 


f  f 


J  ,  »  ,2  r  2  2  , 


+2n{3(a^aj)  (a^l)  (otjl)-(o’aj)2-2(a^i)  (a'c^H  (a’o^)  (ajl)2*^^)  (a’l)  2-4<ajW 


£i>ikV  -  4<?ii)21alkaJk>  +  4J1aL*Jk} 


-  811(0^)  (o±l)  (Ojl)+(2n2+4n)  (o^) 2-(n2+n)  (ajc^)  (ajaj)+2n(a|ai)  (“j1)2 

+2n(a'a  )  (a^l)  2-2<n2-Ki)  <a^l)<f  a  a2  )-2<n2-HO(a’  1)(?  al/jk5 
'  '  '  ~  k-1  J  k-1 

+  (nW-AnHl  A**’  -  6(?i})'2  C?j»2- 

k-1 


yielding 


(4.22)  L  (A) 


!  !  * 
1—1  A— 1 


i-lj-1 


'i,j,k,k'"  rj 


,))  a.  -  8n 


\  f  (a’a  )(a’l)(o’l)+(-2n2+4n)(f  ^  (00 

i-lj-1  J  ~ i-lj-1 


-  (n2+n){f  (a.a  )}2+4n(f  a  a  )(  f  (a ’l)2) 
i-1  ~  '  i-1  ~  '  i-1  1 

-2(n2+n){f  (a'l)(f  a  {[  a2  ,))} 

i-1  k'-rk  j-1  jk 

-2(n2+n){f  (a’l )(\  a  , (f  a2  ))} 
j-1  J  k'-l  ^k  i-1  ik 

+(n3+n2-4n)y  (f  a2  )2-6{f  (ot'l)2}2. 


This  completes  the  proo£  of  the  lemma.  □ 


Remark  4,1.  When  p-1,  b0  bolls  dovm  to  the  univariate  coefficient  of  kurtosis 

*»P 

and  L  (A)  to  a  multiple  of  K^(a),  the  fourth  k-statistic,  as  defined  in  Ferguson 
(1961) . 

Remark  4.2.  It  may  be  noted  that  the  optimality  result  in  Theorem  4.1,  stated 
in  terms  of  L  (A),  is  conditional  on  a  specified  matrix  A.  As  in  Ferguson  (1961) 
and  Schwager  and  Margolin  (1982),  we  notice  that  whenever  l'A-0  and  the 

I  - 

number  M  of  outliers  (which  is  at  least  p  by  our  assumption  made  in  this 

Section)  satisfies  p < M <^,  L*(A)  X)  whatever  A,  thereby  proving  a  sort  of  universal 

.  * 

optimality  of  the  b,  -test.  This  is  because  when  a'l  ■  0,  V  ,  L  (A)  as  defined 

i>P  -I-  I 

in  (4.22)  above  reduces  to 

L*(A)  -  (n3+n2-4n)£  (f  a? )2- (2n2-4n)f  ^  (a'a  )2-(n2+n){f  (a  o  >> 

k-li-1 i-lj-1  i-1  3 

32  ^?22  2  £  2 
j>  (n  +n  -4n)£  Q  a  )  ~3(n  -n){£  (a'a  )}  ,  by  Cauchy-Schwartz  inequality 

k-1  i«l  i-1  1  1 

M  p 

>  {(n3-ta2-4n)-3MCn2-n)}{£  (J  a2  )2}  >  0  if  M  <  §. 

k*l  i-1  J 

* 

For  an  arbitrary  A,  the  expression  L  (A)  can  perhaps  be  further  simplified  into 
a  more  illuminating  form  comparable  to  L(A)  defined  in  (3.11). 

Remark  4.3.  As  mentioned  in  Section  1,  the  result  of  this  paper  can  be  viewed 

as  an  inference  robustness  property  of  Mardia's  b.  -test  against  a  class  of  non- 

-  »P 

normal  distributions.  A  more  general  formulation  of  the  problem  would  be  to 
consider  the  class  of  np-dimensional  left  0(n) -invariant  distributions  satisfying 


L(Q  X)  •  L(X)  for  all  Qc  0(n) .  The  density  of  such  a  distribution  can  be  ex¬ 
pressed  as  f(X)  »  <p(X'X)  where  S(p)  -*>  [0,«).  A  left  0(n) -invariant  distri¬ 
bution  which  is  not  elliptically  symmetric  is  the  matrix  variate  t-distribution, 
whose  density  is  given  by 

fQ(X>  -  c|lp  +  X’X|"(m+ll)/2 

where  m>0  and  c  is  a  normalizing  constant.  While  similar  results  can  be  obtained 
working  with  the  density  f^,  for  an  arbitrary  the  treatment  seems  to  be  diffi¬ 
cult.  This  will  be  taken  up  in  a  future  investigation. 


(A.  2) 


<n-2)!ll  z±z*  <n“2)  (n“3>!niz?z4z*,'*  •••(n-3)iHJ'z2z  z£ 

i*j  1  3  tfj1  j  1  J  *  i*Jft  1  J  1 

...  (n-2)!nz?z,  C»-3)  iniziz4z. '*'... <n~3'!^z?z  z 

i+i+l1  3  1  i+l*b  A  3  ■ 


(0-3)!^!*?*^,.. 

tfj*.  1  3  * 


(n-3) 

UtjVfe  1  3  1 


-(n-2) !A  (n-2)!(e2-A)  (n-3) I (2A-c2)  (n-3) !  (2A-c2).  Xn-3) ! (2A-c2) 

-(n-2) !A  *(n-3)I(2A-c2)  (n-3)  !  (2A-C2).  .(n-3)  !  (2A-c2) 
..  ..  (n-3)  I  (2A-c2)  (n-4) ! (3c2-6$ .  fc-4) ! (3c2-6A) 


(n-3)  l  (2A-c2)  v  ..4-4 


(n-3) l (2A-c*) 


m 

h| 


and  in  general  E^z^z^e^ejr^z^  is  obtained  by  Interchanging  the  first  row,  first 

coluam  of  (A. 2)  with  the  ith  row,  ith  aolumn  and  second  row,  second  column  of  (A. 2)  with 

n  4  n  2 

the  jth  row,  jth  column,  where  A  ■  £z*:  and  c  *  £z  .  In  order  to  evaluate  (4.16) 

1  1  1 

and  (4.17)  we  need  an  extension  of  these  results  requiring  computations  of  the 
following  quantities. 

(*.3)  (i)  l  f  l  z2uz2u,  -i  (f  ,2  )(£  z2  }-l  (f  A)2 

n  n  P  P’  _  n 

"  feJ(x-lx,)“Mi(x-lx,),e  }]2-f  (e!  (x-l^S^Cx-lx’ je.  }2 
i-lfcp*l”*  "  "  -1  i«i  -1  "  -  "  -i 


•  l  (x  -x)’S_1(x  -x)}2  -  ; 

1-1  -1  -  -1  -  n 


(it)  l  l  11  I  !  i  !  = 

lml  4*-l  i^i'-l  14  1  14  4-1  i'-li-li'-l14  14  14  4-14' -11-1 


*14*14' 


b,  _  n 

“  by  (i)  and  £  z.,  ,  -  0,  V  4'  ; 

n  i»-i  1  4  J 


cm)?!  ],!  i  i  ?44.-(!d4))2-V 

4-1 4,-Hri'“l  1114  4-14' -11-11' -1  i4  14  4-14’-ll-li£  ±£  4-11-1  14 


p  P'SP„  _  b„  .  b. 

■tf  -\-i>2  -  -  p2  -  -2**  ; 

4-1  X4  ° 


nn  n  n  p  p  n  n 

I  l  I  ziJ.Zi!'V*2l»4'  *  "Il  II  Z14Zi4'Zi'4(zi4'+Zi' 
4-14 '  -11^1 '  j*i"»l  14  14  1414  4-l4'-llf‘.i'-l  14  14  1  1 

m  ^  I  Z14,Zi4Zi'4  ”  ^  ^  I  zi  ’ Z4  '  cz-f  1  o  ' 

4-1  4'-l  ijU'-l  14  14  1  4-1  4 '-1  i^i'-l  14  1414 


•V-H  I  ivii'ViVi'^  !  ! 

n  4-14'-ll-li’-r  14  1414  4-14'-li-l  14  14 

b  p  p  n  ,  b_  nnp,  P  P! 

-  -  l  I  (l  z  z  )2-2(-^)-J  l  {J  e  (x-lx')-P<x-lx')'e 

n  4-14’-l  1-1  14  14  n  i-li'-ll-r1  —  A4  ~~  -1 

-  2H=^)  -  tr [ (x-lx' )S_1(x-lx' )  '  ]2-  2(^)-p,  using  (1),  (11), 

n  ..  _ _  n 


the  definition  of  S  -  £  and  the  fact  that  for  any  symmetric 

4-1  4  4  4 


matrix  B,  l  l  (e’Be  ,)2  -  tr  B2  ; 
1  1'  ~  -1 


nnnnn  ppnnn 

I  I  I  I  zj o za  » qzi "a ' zt'"  a '  = “I  I  I  I  I 

b  p  p  n  n  n  2 

(z.  ,+z. ,  ,+z  „  ,)  "  -4(  -,P)  +  2p  -  £  5!  I  ll  z.„. 

b_  p  p  n  n  * 

*  -4( — £^)  +  2p  ~'l  L  1  l  zii*i'£^  Z±l’~Zil’  ~  Zi'£'^ 

•-4(^)+2p-f  l  l  ?  *1i*1.£-2(^)[u8ing  l  z\  ,-1.  V  S’  and  (ii)J 

n  '  S-lS'-li^i'-l  iA  1  z  n  i-1  11 

b  p  n  «  n 

-  -6(-2*£)  +  2p  +  P  l  l  z  ,  [using  £  z  ,lM~zijL>  * 

n  i-l  i-1  i'^i-l  1  1  ■  11 


m  -6(-j»P)  +  2p  +  p2 


In  (A. 3)  above,  we  have  taken  z^  -  (x-lx'JP^/Zx^  »  £"1»....P  and  z±jL  stands 
for  the  ith  element  of  the  vector  z^,  i»l,...,n.  An  argument  similar  to  that 
used  to  proved  (A.l)  and  (A. 2)  and  the  use  of  the  computations  in  (A. 3)  lead 
to  the  final  expressions. 


(A*4>  Ji  ],./a!ia?ia!l?i?£,a!£-o 


D  Du  D0 

r(n-l)!(-^)  -(n-2)!(-^)  -(n-2)!(-J^)  ...  -(n-2) !  (~~ Jt£-) 

n  n  n  n 

(n-2)  I  (p2-  (n-3) !  (2  ^-p)  . .  (n-3) !  (2-J*2 

n  n  n 

2  b  n 

(n-2)  I  (p  -  . .  (n-3) !  (2 

n  i> 


_  o 

(n-2) (p2  -  -r^ 


(- ““) (n-3) !  (n-1) (n-2)  -(n-2)  -(n-2)  ., 

n 


+  p(n-3) ! 


-(n-2) 


p(n-2) 


-(n-2)> 


-(n-2)  ... 


-(n-2) 


p(n-2)  ...  -1 


p(n-2) j 


and  in  general  l  l  Iazaaziaeke4zji'az£,'a  is  obtained  h?  interchanging  the 
i  *1 

first  row,  first  column  of  (A. 4)  with  the  kth  row,  kth  column,  thus  proving 
(4.16); 


(a. 5)  i  i 


i-1  i'-l 


a. i'a 


b  |)  2b  2b  2b 

-(n-2).'— ^  (n-2)'(p2-  -^)  (n-3)  l  (~^-p)  (n-3)  I (— j^-p)  ...(n-3)  !  (— ^ - 

n  n  n  n  n 


-(n-2)!-^2 


2b,  n 

(n-3):  (—f^- 

n 

2b„  _ 


-  2b-  2b- 

^-p)  (n-3)!(— ^-p)...4i-3)I(— £^-p) 

n  n  u 


(n-3)  !  (— ^ -p)  (n-4)  I  (-— l£+2p+p2)  ..(n-4)  '.  ( - jf^p-tp 

n  n  n 

2b,  b  , 

(n-3)!(_Jj£-p)  ...(n-4)I(-6  *»p-+2pV) 


(n-3) !  ( 


(n-4) ! 


-(n-2) (n-3)  -(n-2)(n-3)  2(n-3)  2(n-3). 


2(n-3) 


.  —  i.P 
n 


- (n-2) (n-3)  2 (n-3)  2 (n-3) . 

2 (n-3)  -6  . 

(2 (n-3) 


. 2 (n-3) 

• •  •  •  •  —6 

•  •  •  •  • 


2 (n-3) 


+P(n-4) ! 

0 

p(n-2) (n-3) 

-(n-3) 

-(n-3). 

.  .-(n-3) 

0 

-(n-3) 

-(n-3). 

.  .-(n-3) 

-(n-3) 

(P+2)  . 

.  •  (p+2) 

-(n-3). 

.  •  (p+2) 

**  -(n-3)  J 


and  in  general  }  }  £  z.  z  e.e.  ,z  ,  zl,  is  obtained  by  interchanging  the 

first  row,  first  column  of  (A. 5)  with  the  kth  row,  kth  column  and  second  row. 


second  column  of  (A. 5)  with  the  k' throw,  k'th  column,  thus  establishing  (4.17) 
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